A novel feature-scrambling approach reveals the capacity of convolutional neural networks to learn spatial relations

Convolutional neural networks (CNNs) are one of the most successful computer vision systems to solve object recognition. Furthermore, CNNs have major applications in understanding the nature of visual representations in the human brain. Yet it remains poorly understood how CNNs actually make their decisions, what the nature of their internal representations is, and how their recognition strategies differ from humans. Specifically, there is a major debate about the question of whether CNNs primarily rely on surface regularities of objects, or whether they are capable of exploiting the spatial arrangement of features, similar to humans. Here, we develop a novel feature-scrambling approach to explicitly test whether CNNs use the spatial arrangement of features (i.e. object parts) to classify objects. We combine this approach with a systematic manipulation of effective receptive field sizes of CNNs as well as minimal recognizable configurations (MIRCs) analysis. In contrast to much previous literature, we provide evidence that CNNs are in fact capable of using relatively long-range spatial relationships for object classification. Moreover, the extent to which CNNs use spatial relationships depends heavily on the dataset, e.g. texture vs. sketch. In fact, CNNs even use different strategies for different classes within heterogeneous datasets (ImageNet), suggesting CNNs have a continuous spectrum of classification strategies. Finally, we show that CNNs learn the spatial arrangement of features only up to an intermediate level of granularity, which suggests that intermediate rather than global shape features provide the optimal trade-off between sensitivity and specificity in object classification. These results provide novel insights into the nature of CNN representations and the extent to which they rely on the spatial arrangement of features for object classification

Arousal and Locomotion Make Distinct Contributions to Cortical Activity Patterns and Visual Encoding

SummarySpontaneous and sensory-evoked cortical activity is highly state-dependent, yet relatively little is known about transitions between distinct waking states. Patterns of activity in mouse V1 differ dramatically between quiescence and locomotion, but this difference could be explained by either motor feedback or a change in arousal levels. We recorded single cells and local field potentials from area V1 in mice head-fixed on a running wheel and monitored pupil diameter to assay arousal. Using naturally occurring and induced state transitions, we dissociated arousal and locomotion effects in V1. Arousal suppressed spontaneous firing and strongly altered the temporal patterning of population activity. Moreover, heightened arousal increased the signal-to-noise ratio of visual responses and reduced noise correlations. In contrast, increased firing in anticipation of and during movement was attributable to locomotion effects. Our findings suggest complementary roles of arousal and locomotion in promoting functional flexibility in cortical circuits.Video Abstrac

Specific Contributions of Ventromedial, Anterior Cingulate, and Lateral Prefrontal Cortex for Attentional Selection and Stimulus Valuation

Functional clusters of neurons in the monkey prefrontal and anterior cingulate cortex are involved in guiding attention to the most valuable objects in a scene

Selective Theta-Synchronization of Choice-Relevant Information Subserves Goal-Directed Behavior

Theta activity reflects a state of rhythmic modulation of excitability at the level of single neuron membranes, within local neuronal groups and between distant nodes of a neuronal network. A wealth of evidence has shown that during theta states distant neuronal groups synchronize, forming networks of spatially confined neuronal clusters at specific time periods during task performance. Here, we show that a functional commonality of networks engaging in theta rhythmic states is that they emerge around decision points, reflecting rhythmic synchronization of choice-relevant information. Decision points characterize a point in time shortly before a subject chooses to select one action over another, i.e., when automatic behavior is terminated and the organism reactivates multiple sources of information to evaluate the evidence for available choices. As such, decision processes require the coordinated retrieval of choice-relevant information including (i) the retrieval of stimulus evaluations (stimulus–reward associations) and reward expectancies about future outcomes, (ii) the retrieval of past and prospective memories (e.g., stimulus–stimulus associations), (iii) the reactivation of contextual task rule representations (e.g., stimulus–response mappings), along with (iv) an ongoing assessment of sensory evidence. An increasing number of studies reveal that retrieval of these multiple types of information proceeds within few theta cycles through synchronized spiking activity across limbic, striatal, and cortical processing nodes. The outlined evidence suggests that evolving spatially and temporally specific theta synchronization could serve as the critical correlate underlying the selection of a choice during goal-directed behavior

Network-selectivity and stimulus-discrimination in the primary visual cortex : cell-assembly dynamics

Abstract : Visual neurons coordinate their responses in relation to the stimulus; however, the complex interplay between a stimulus and the functional dynamics of an assembly still eludes neuroscientists. To this aim, we recorded cell assemblies from multi-electrodes in the primary visual cortex of anaesthetized cats in response to randomly presented sine-wave drifting gratings whose orientation tilted in 22.5° steps. Cross-correlograms divulged the functional connections at all the tested orientations. We show that a cell-assembly discriminates between orientations by recruiting a ‘salient’ functional network at every presented orientation, wherein, the connections and their strengths (peak-probabilities in the cross-correlogram) change from one orientation to another. Within these assemblies, closely tuned neurons exhibited increased connectivity and connection-strengths than differently tuned neurons. Minimal connectivity between untuned neurons suggests the significance of neuronal selectivity in assemblies. This study reflects upon the dynamics of functional connectivity, and brings to the fore the importance of a ‘signature’ functional network in an assembly that is strictly related to a specific stimulus. Apparently, it points to the fact that an assembly is the major ‘functional unit’ of information processing in cortical circuits, rather than the individual neurons

Plasticity of the β-Trefoil Protein Fold in the Recognition and Control of Invertebrate Predators and Parasites by a Fungal Defence System

Discrimination between self and non-self is a prerequisite for any defence mechanism; in innate defence, this discrimination is often mediated by lectins recognizing non-self carbohydrate structures and so relies on an arsenal of host lectins with different specificities towards target organism carbohydrate structures. Recently, cytoplasmic lectins isolated from fungal fruiting bodies have been shown to play a role in the defence of multicellular fungi against predators and parasites. Here, we present a novel fruiting body lectin, CCL2, from the ink cap mushroom Coprinopsis cinerea. We demonstrate the toxicity of the lectin towards Caenorhabditis elegans and Drosophila melanogaster and present its NMR solution structure in complex with the trisaccharide, GlcNAcβ1,4[Fucα1,3]GlcNAc, to which it binds with high specificity and affinity in vitro. The structure reveals that the monomeric CCL2 adopts a β-trefoil fold and recognizes the trisaccharide by a single, topologically novel carbohydrate-binding site. Site-directed mutagenesis of CCL2 and identification of C. elegans mutants resistant to this lectin show that its nematotoxicity is mediated by binding to α1,3-fucosylated N-glycan core structures of nematode glycoproteins; feeding with fluorescently labeled CCL2 demonstrates that these target glycoproteins localize to the C. elegans intestine. Since the identified glycoepitope is characteristic for invertebrates but absent from fungi, our data show that the defence function of fruiting body lectins is based on the specific recognition of non-self carbohydrate structures. The trisaccharide specifically recognized by CCL2 is a key carbohydrate determinant of pollen and insect venom allergens implying this particular glycoepitope is targeted by both fungal defence and mammalian immune systems. In summary, our results demonstrate how the plasticity of a common protein fold can contribute to the recognition and control of antagonists by an innate defence mechanism, whereby the monovalency of the lectin for its ligand implies a novel mechanism of lectin-mediated toxicity

Investigating large-scale brain dynamics using field potential recordings: Analysis and interpretation

New technologies to record electrical activity from the brain on a massive scale offer tremendous opportunities for discovery. Electrical measurements of large-scale brain dynamics, termed field potentials, are especially important to understanding and treating the human brain. Here, our goal is to provide best practices on how field potential recordings (EEG, MEG, ECoG and LFP) can be analyzed to identify large-scale brain dynamics, and to highlight critical issues and limitations of interpretation in current work. We focus our discussion of analyses around the broad themes of activation, correlation, communication and coding. We provide best-practice recommendations for the analyses and interpretations using a forward model and an inverse model. The forward model describes how field potentials are generated by the activity of populations of neurons. The inverse model describes how to infer the activity of populations of neurons from field potential recordings. A recurring theme is the challenge of understanding how field potentials reflect neuronal population activity given the complexity of the underlying brain systems

Using social and behavioural science to support COVID-19 pandemic response

The COVID-19 pandemic represents a massive global health crisis. Because the crisis requires large-scale behaviour change and places significant psychological burdens on individuals, insights from the social and behavioural sciences can be used to help align human behavior with the recommendations of epidemiologists and public health experts. Here we discuss evidence from a selection of research topics relevant to pandemics, including work on navigating threats, social and cultural influences on behaviour, science communication, moral decision-making, leadership, and stress and coping. In each section, we note the nature and quality of prior research, including uncertainty and unsettled issues. We identify several insights for effective response to the COVID-19 pandemic, and also highlight important gaps researchers should move quickly to fill in the coming weeks and months

Status Update and Interim Results from the Asymptomatic Carotid Surgery Trial-2 (ACST-2)

Objectives: ACST-2 is currently the largest trial ever conducted to compare carotid artery stenting (CAS) with carotid endarterectomy (CEA) in patients with severe asymptomatic carotid stenosis requiring revascularization. Methods: Patients are entered into ACST-2 when revascularization is felt to be clearly indicated, when CEA and CAS are both possible, but where there is substantial uncertainty as to which is most appropriate. Trial surgeons and interventionalists are expected to use their usual techniques and CE-approved devices. We report baseline characteristics and blinded combined interim results for 30-day mortality and major morbidity for 986 patients in the ongoing trial up to September 2012. Results: A total of 986 patients (687 men, 299 women), mean age 68.7 years (SD ± 8.1) were randomized equally to CEA or CAS. Most (96%) had ipsilateral stenosis of 70-99% (median 80%) with contralateral stenoses of 50-99% in 30% and contralateral occlusion in 8%. Patients were on appropriate medical treatment. For 691 patients undergoing intervention with at least 1-month follow-up and Rankin scoring at 6 months for any stroke, the overall serious cardiovascular event rate of periprocedural (within 30 days) disabling stroke, fatal myocardial infarction, and death at 30 days was 1.0%. Conclusions: Early ACST-2 results suggest contemporary carotid intervention for asymptomatic stenosis has a low risk of serious morbidity and mortality, on par with other recent trials. The trial continues to recruit, to monitor periprocedural events and all types of stroke, aiming to randomize up to 5,000 patients to determine any differential outcomes between interventions. Clinical trial: ISRCTN21144362. © 2013 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved